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Abstract. In this paper, we give a decomposition of triply rooted trees into three 
doubly rooted trees. This leads to a combinatorial interpretation of an identity con- 
jectured by Lacasse in the study of the PAC-Bayesian machine learning theory, and 
proved by Younsi by using the Hurwitz identity on multivariate Abel polynomials. We 
also give a bijection between the set of functions from [n + 1] to [n] and the set of triply 
rooted trees on [n], which leads to the refined enumeration of functions from [n + 1] 
to [n] with respect to the number of elements in the orbit of n + 1 and the number of 
periodic points. 
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Lacasse [I] introduced the functions and ^(n) in his study of the classical PAC- 
Bayes theorem in the theory of machine learning, where 



and 



k=0 



n n—j / \ / -\/-\i/i\k/ ■ , \ n—j—k 

n\ ( n — j\ ] \ k\ I j '■ x 



«») = EE(?) 



k J \n J \n J V n n 



j=0 k=0 

He showed that £(n) can be used to give a tighter bound of the Kullback-Leibler 
divergence between the risk and the empirical risk on a sample space S of a hypothesis 
function in a hypothesis space, whereas can be used to bound the Kullback-Leibler 
divergence between the risk and the empirical risk on S of the joint distribution of two 
hypothesis functions in a hypothesis space. 

While £2(7^) is a double sum, based on numerical evidence Lacasse [1] posed the 
following conjecture stating that £2^) can be reduced to the single sum £(n). 
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Conjecture 1.1 For n G N, we have 

6(ra) = £(n) + n. 



(1.1) 



By applying an identity of Hurwitz on multivariate Abel polynomials, Younsi [7] 
gave an algebraic proof of this conjecture. Recall that multivariate Abel polynomials 
are defined by 
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where Xi,x 2 , ■ ■ ■ ,x m G K and pi,P2, ■ ■ ■ ,p m e ^- Hurwitz proved that under certain 
conditions, the polynomials y4„(xi,x 2 , . . . ,x m ;pi,p 2 , • • • ,p m ) reduce to single sums. In 
particular, when p\ = p 2 = ■ ■ ■ = p m = 0, we have 



A n (x 1 , . . . , x m ; 0, . . . , 0) = y~] ( ™ ) (x l + 

fe=o ^ ' 



x 2 + --- + x m + n) n - k a k (m-l), (1.2) 



where ctfc(r) = r(r + l) ■ • • (r+k — l) is the rising factorial, see, for example, Riordan [5]. 

Younsi [7] observed that f(n) = A n (0,0;0,0) and £ 2 (n) = A n (0, 0, 0; 0, 0, 0), and 
obtained the following expressions for £(n) and £ 2 (n) by the above identity (11.21) . 
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Conjecture 11.11 can be easily deduced from (11.31) and (11.41) . 

In this paper, we give a combinatorial explanation of relation (jl.ip . Rewriting (II. ip 



as 
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we see that it is equivalent to the following form 
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The right hand side of (11.61) indicates that we need the notion of triply rooted trees, 
namely, labeled trees with three distinguished, but not necessarily distinct vertices. 
To be more specific, the three distinguished vertices of a triply rooted tree are called 
the first, the second and the third root, respectively. It can be easily seen that the 
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summand on the left hand side of (II. 6p can be interpreted as the number of triples of 
doubly rooted trees with a given number of vertices in each doubly rooted tree. Hence 
relation (ll.6p can be deduced from a decomposition of a triply rooted tree into three 
doubly rooted trees. 

The second result of this paper is a correspondence between the set of functions 
from [n + 1] to [n] and the set of triply rooted trees on [n]. Let / be a function from 
[n + 1] to [n] and let T be the corresponding triply rooted tree. We find that the orbit 
of n + 1 on / is mapped to the set of ancestors of the second root in T, and the set 
of periodic points of / is mapped to the set of ancestors of the third root in T. Based 
on this property of our bijection, we derive a formula for the number of functions from 
[n + 1] to [n] with a given number of elements in the orbit of n + 1 and a given number 
of periodic points. 

2 Decomposition of triply rooted tree 

In this section, we give a combinatorial interpretation of Lacasse's identity by providing 
a decomposition of a triply rooted tree into three doubly rooted trees. 

Recall that a rooted tree is defined to be a labeled tree with a specific vertex, which 
is called the root. Let R n denote the set of rooted trees on [n\. The set i? n is counted 
by n n_1 , see Stanley [21 5.3.2 Proposition]. A doubly rooted tree is defined as a labeled 
tree with two distinguished vertices r% and r 2 , where we call T\ the first root and call 
r<i the second root. Notice that the two roots of a doubly rooted tree are not required 
to be distinct. We denote by D n the set of doubly rooted trees on [n]. From the 
formula for \R n \, one sees that \D n \ = n n . The notion of doubly rooted trees leads to 
be an elegant proof of the formula for \D n \ independently obtained by Goulden and 
Jackson |2] and Joyal [3J. 

The identity (II. 6p indicates that there is a decomposition of a triply rooted tree 
into three doubly rooted trees. More precisely, we define a triply rooted tree to be a 
labeled tree with three distinguished vertices r\,V2, and r^, which are called the first, 
the second, and the third root, respectively. Again, the three roots of a triply rooted 
tree are not necessarily distinct. Denote by T n the set of triply rooted trees. From the 
formula for \D n \ it is clear that \T n \ = n n+1 . So the right hand side of (II. 6p can be 
interpreted as the number of triply rooted trees on [n\. 

On the other hand, let Q n denote the set of triples of doubly rooted trees (D, D' , D") 
such that the vertex sets of D, D', D" form a composition of [n] with D being nonempty. 
To be more specific, a triple (X, Y, Z) of subsets of a set S is said to be a composition 
of S if X, Y, and Z are disjoint and their union equals S. It is obvious that Q n is 
counted by 
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which is the left hand side of ( 11. 6j) . Hence identity ( 11. 6ft follows from the following 
bijection. 

Theorem 2.1 For n > 1, there is a bijection between Q n and T n . 

To present the proof of the above theorem, we recall some terminology. Given two 
vertices i and j of a rooted tree T, we say that j is a descendant of i, or z is an ancestor 
of j, if i lies on the unique path from the root to j. In particular, each vertex is a 
descendant as well as an ancestor of itself. A child of i means a descendant j of % such 
that is an edge of T. The depth of i is defined to be the number of edges of the 
unique path from the root to i. Given two vertices t>i and vi of T, there is a unique 
vertex v that is the common ancestor of v± and t>2 with the largest depth. This vertex 
is called the least common ancestor of V\ and V2, see Aho, Hopcroft and Ullman pp. 
For example, for the tree in Figure 12.11 t ne least common ancestor of 1 and 3 is 5, 
while the least common ancestor of 1 and 6 is the root 4. 
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Figure 2.1: A rooted tree on [6]. 

Throughout this paper, we use ri(D) and r 2 (D) to denote the first root and the 
second root of a doubly rooted tree D, respectively, and we use ^(T), r 2 (T) and r 3 (T) 
to denote the first root, the second root and the third root of a triply rooted tree T, 
respectively. 

Proof of Theorem \2.1[ We define a map if from Q n to T n . Given a triple (D, D', D") 
of doubly rooted trees in Q n , we aim to construct a triply rooted tree on [n]. First, we 
consider the case when neither D' nor D" is empty. 

We merge D and D' by setting ri(D') to be a child of ^(.D), and we merge D and 
D" by setting ri(D") to be a child of ^(-D). By setting r2(D') and r2(D") to be the 
second root and the third root of the resulting tree, we obtain a triply rooted tree T. 

For example, Figure 12.21 gives an illustration of a triple of doubly rooted trees and 
the corresponding triply rooted tree, where the second root is represented by a solid 
square, and the third root is represented by a hollow square. 

We now consider the case when either D' or D" is empty. If D' = and D" ^ 0, we 
merge D and D" by setting ri(D") to be a child of ^(-D). Setting ^(-D) and r2(D") 
to be the second root and the third root, we obtain a triply rooted tree T. 
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Figure 2.2: The merging process when D' ^ and D" ^ 0. 



If D' ^ and D" = 0, we merge D and D' by setting ri(D') to be a child of r 2 (.D). 
Setting r 2 (D') and r 2 (D) to be the second root and the third root, we obtain a triply 
rooted tree T. 

If both .D and D" are empty, then we set r 2 (D) to be the second root and the third 
root to obtain a triply rooted tree T. 

In summary, (rj.(T), r 2 (T), r 3 (T)) is given as follows: 

' (r 1 (D),r 2 (fl , ) I r 2 (f")) I if D' ^ 0, and D" ^ 0; 

(r 1 (D),r 2 (£>),r 2 ( J D' , )) ) if D' = 0, and D" ^ 0; 

(r 1 ( J D),r 2 ( J D'),r 2 ( J D)), if D' ^ 0, and D" = 0; 

^ (r 1 ( J D),r 2 ( J D),r 2 (D)), if D' = 0, and D" = 0. 

Figure [2731 gives an illustration of the merging process when D' — and D" 7^ 0. 
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Figure 2.3: The merging process when D' — and Z)" 7^ 0. 



To show that the above process is invertible, we give a description of the inverse 
procedure. Given a triply rooted tree T with three roots r 1; r 2 and r 3 , assume that w 
is the least common ancestor of r 2 and r 3 . 
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We first consider the case when w ^ r 2 and w ^ r 3 . We proceed to find two edges 
such that by removing them we can recover three doubly rooted trees D, D' and D" . 
Find the child x of w such that r 2 is a descendant of x, and the child y of w such that 
r 3 is a descendant of y. Removing the edges (w,x) and (w,y), we get three trees with 
three roots r±, x and y. Let D be the doubly rooted trees with two roots r± and w, 
let D' be the doubly rooted trees with two roots x and r 2 , and let D" be the doubly 
rooted trees with two roots y and r 3 . 

Next we consider the remaining cases. When w = r 2 and «j/r 3 , suppose that y is 
the child of w such that r 3 is a descendant of y. Removing the edge (w,y), we get a 
doubly rooted tree D with two roots T\ and a doubly rooted tree D" with two roots 
y and r 3 . Moreover, we set D' = 0. 

When w = r 3 and w ^ r 2 , suppose that x is the child of w such that r 2 is a 
descendant of x. Removing the edge (w,x), we get a doubly rooted tree D with two 
roots r\ and w and a doubly rooted tree .D' with two roots x and r 2 . Meanwhile, we 
set £>" = 0. 

When to = r 2 = r 3 , let D to be the doubly rooted tree obtained from T by setting 
the two roots to be r x and w, and let D' = and £>" = 0. 

It can be easily checked that in any case the three doubly rooted trees D, D' and 
D" can be merged into the triply rooted tree T. That is, the above merging process is 
invertible. This completes the proof. I 



3 Functions from [n + 1] to [n] 

In this section, we establish a correspondence between functions from [n + 1] to [n] and 
triply rooted trees on [n] , which maps the orbit of n + 1 to the set of ancestors of the 
second root, and maps the set of periodic points to the set of ancestors of the third 
root. By the symmetry between the second and third roots, we deduce a symmetry 
property of the number of functions from [n + 1] to [n] with respect to the number of 
periodic points and the size of the orbit of n + 1. 

Given a function / from [n + 1] to [n] , the orbit of x on / is defined to be the set 
{x, f(x), f 2 (x), . . .}. If there exists some j > 1, such that p(x) = x, then x is called a 
periodic point of /. We have the following correspondence. 

Theorem 3.1 There is a bijection (f) between the set of functions f from [n+ 1] to [n] 
and the set of triply rooted trees on [n] such that the orbit ofn+1 on f excluding n + 1 
itself is mapped to the set of ancestors of the second root of (j)(f) and the set of periodic 
points of f is mapped to the set of ancestors of the third root of 4>(f). 

Proof. The map can be described as follows. Let / be a function from [n + 1] to 
[n]. We proceed to construct a triply rooted tree T on [n] based on the function /. 
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We begin with the functional digraph Gf of /, that is, a digraph on [n + 1] with arcs 
(i, f(i)) for 1 < i < n + 1. Let Ci be the connected component of containing the 
vertex n + 1. Consider the longest path P starting from n + 1, say, 

P : n + 1 = uo — >■ Mi — > w 2 —>■••• — >■ ttfc. 

In other words, is the smallest integer such that f(uk) = Uj for some j < k. Removing 
the arc (uk, Uj) and the vertex n + 1 from C*i, we get a tree H rooted at u^. 

Let C 2 be the digraph Gf\C\. When C 2 = 0, we set u k , u\ and Uj to be the three 
roots of H to obtain a triply rooted tree T. 

When C 2 ^ 0, suppose that the vertex set of C 2 is {vi, v 2 , ■ ■ ■ , v s }. Note that C 2 is a 
functional digraph on {vi, f 2 , . . . , By applying the bijection between functions and 
doubly rooted trees, obtained by Joyal [3] and Goulden and Jackson [2] , C 2 corresponds 
to a doubly rooted tree D on {v i, v 2 , . . . ,v s }. Let Wi and w 2 be the two roots of D. 

Finally, we merge the rooted tree H and the doubly rooted tree D by joining the 
first root W\ of D and the vertex Uj of H with W\ being the child. Setting Ui and 
w 2 to be the first, the second and the third root, respectively, we get a triply rooted 
tree T, and we set (f>(f) = T. 

For example, let / be the following function from [13] to [12], 

/12345 6 78 9 10 11 12 13 \ 
• / ~l v 86854 12 46 12 2 4 2 3 J ' 

The functional digraph of / is given in Figure I3.4[ where C\ is the functional digraph on 
{1, 2, 3, 6, 8, 9, 10, 12, 13} and C 2 is the functional digraph on {4, 5, 7, 11}. The longest 




13 3 2 10 7 11 



Figure 3.4: The functinal digraph Gf. 

path starting from 13 is 

P: 13 -> 3 -> 8 -> 6 -> 12 -> 2, 

with /(2) = 6, that is, i*i = 3, — 2 and = 6 as in the proof. Deleting the arc 
(2,6) and vertex 13, we get a rooted tree H as illustrated in Figure [3751 By applying 
the bijection between functional digraphs and doubly rooted trees, C 2 can be mapped 
to a doubly rooted tree D with roots 5 and 4 as shown in Figure 13. 5^ where W\ — 5 
and w 2 = 4 as in the proof. Merging H and D by adding an edge (6, 5) and setting 
2, 3 and 4 to be the three roots, we get a triply rooted tree T in Figure 13.51 
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Figure 3.5: An example of the bijection <f>. 



The map is indeed a bijection. The inverse map can be described as follows. For 
a triply rooted tree T e T n with the three roots ri,r 2 and r 3 , we first find the least 
common ancestor of r 2 and r 3 , and we denote it by u . Suppose that the unique path 
P from uq to r 3 in T is UqU\ • • - U{ = r 3 . Removing the edge (u , Ui) from T, we get 
two components T\ and T 2 , where Ti is rooted at T\ and T 2 is rooted at u\. Adding 
n + 1 to Ti by setting it as a child of r 2 . Now, Ti can be viewed as a directed graph 
by making each edge point to the father. Then we add the arc (7*1 , Mo) to T\ to obtain 
a connected functional digraph C\. 

Next, we transform T 2 rooted at U\ into a doubly rooted tree by setting r 3 to be the 
second root. Then we get a functional digraph C 2 by applying the inverse map of the 
bijection of Joyal [3] and Goulden and Jackson [2]. 

Finally, let G = C\ U C 2 . It is easily seen that G is a directed graph on [n + 1] such 
that each vertex has outdegree one and the vertex n + 1 has indegree zero. In other 
words, G is the functional digraph of a function from [n + 1] to [n] . It can be checked 
that the above procedure is indeed the inverse of the map 4>. 

It remains to prove the properties of <fi as stated in the theorem. For a function / 
from [n+ 1] to [n], an element x is a periodic point in / if and only if it is a vertex in a 
cycle in the functional digraph Gf. It can be seen that x is in a cycle if and only if it is 
an ancestor of the third root in the triply rooted tree <fi(f)- Moreover, it can be checked 
that each element y in the orbit of n + 1 on / other than n + 1 itself corresponds to an 
ancestor of the second root in the triply rooted tree <fi(f)- This completes the proof. I 

For example, for the function / in Figure |3~31 there are five periodic points 2, 12, 6, 5, 4, 
which are the vertices in the path from the root 2 to the third root 4 in <fi{f) as demon- 
strated in Figure 13.51 The orbit of 13 consists of 13,3,8,6,12,2. These elements 
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3, 8, 6, 12, 2 correspond to the vertices in the path from the root 2 to the second root 3 
in </>(/). 

From the above bijection 0, we obtain a formula for the number of functions from 
[n + 1] to [n] with a given number of elements in the orbit of n + 1 and a given 
number of periodic points. This formula implies a symmetry property, which can also 
be interpreted in terms of triply rooted trees. 

Theorem 3.2 For n > 1, let W n> ij denote the set of triply rooted trees on [n] such 
that the depth of the second root is i and the depth of the third root is j . Then we have 

min(ij) . . . . 

(n-i-3 + d-l)\ 
where \ W nji j\ is the cardinality ofW n ^j. 

Proof. Let W n ^j(d) denote the set of triply rooted trees T in W n jj such that d is the 
depth of the least common ancestor of the second root and the third root of T. We 
proceed to show that W ni ij(d) is enumerated by the summand on the right hand side 
of (EU). 

Let T be a triply rooted tree in W n ^j{d). We denote by Pi the path from the first 
root to the second root and denote by P2 the path from the first root to the third root. 
It can be seen that there are exactly k = i + j — d+1 vertices on Pi and P^. Hence 
the number of ways to form Pi and P2 equals jr^zm - Moreover, it is known that there 
are kn n ~ k ~ 1 forests consisting of k rooted trees on [n] with k given roots. It follows 
that W n i j(d) is enumerated by the summand on the right hand side of (13.21) . This 
completes the proof. I 

Combining Theorem 13.11 and Theorem 13.21 we arrive at the following formula for 
the refined enumeration of functions from [n + 1] to [n] . 

Theorem 3.3 For n > 1, let F n ^j denote the set of functions from [n + 1] to [n] such 
that the size of the orbit of n + 1 is i and the number of periodic points is j. Then we 
have 

\fin,i+i,j\ - >. 7 — : — — nrr ra • \ 6 - 2 ) 

[n-i-j + s + l)\ 

By the symmetry of the second roots and the third roots for T n , we can conclude a 
symmetry relation of functions from [n + 1] to [n] concerning the size of orbit of n + 1 
and the number of periodic points, that is, 

= |-^n,j+l,j|- (3-3) 

Notice that the above symmetry is implied by (13. 2p . 
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